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Description 

[0001] The present invention relates to a viewer reception system and to a method of receiving interactive program- 
ming, and to a method and system for providing interactive programming. 

5 [0002] Interactive video and audio presentation systems are currently being introduced into the entertainment and 
educational industries. A prominent interactive technology that has been applied successfully in these industries is 
based on providing interactivity in a one-way system through the provision of multiple time-synched parallel channels 
of information. For example, U.S. patents nos. 4,264,925 and 4,264,924, both provide audio and video interactivity 
and disclose interactive television systems where switching among multiple broadcast or cable channels based on 

10 viewer selections provides an interactive capability. 

[0003] US-A-5,585,858 describes a system in which a television program, can be watched on any conventional 
television set as a normal program, but where the viewer has a special interactive program box connected to the 
television, a fully functional interactive program can be additionally provided. Each interactive viewer enjoys person- 
alized audio responses and video graphics overlayed on the screen. The interactive program may be provided to 

15 television sets or to computers by cable, direct broadcast satellite, television broadcast or other transmission means, 
and may be analog or digital. 

[0004] WO-A-9637075 and US-A-5,600,368 describe an interactive television system where, at a receiver, the viewer 
may selectively switch between video signals. In the system of WO-A-9637075, a processor at the receiver directs the 
switch based on viewer selections and branching codes incorporated in the video signals. 
20 [0005] However, what is needed is an interactive presentation system for providing true video, audio and graphics 
interactivity with digital programs broadcast live. Such a system must efficiently package all the digital elements of the 
live interactive program at a centralized control studio and allow viewers at home to receive personalized interactive 
programming. 

[0006] According to a first aspect of the present invention, there is provided a viewer reception system for receiving 

25 interactive programming, the interactive programming comprising a plurality of synchronised and compressed, live and 
prerecorded, video signals and graphics signals, a plurality of compressed, live and prerecorded audio signals, and 
branching codes which have been multiplexed with said video, graphics and audio signals, and said viewer reception 
system comprising: a viewer interface for receiving viewer entries; processing means, responsive to the viewer inter- 
face, for determining which of the received video, graphics and audio signals to play; a demultiplexer for selecting and 

30 demultiplexing a specific video signal under the control of said processing means; a decompressor/decoder connected 
to the demultiplexer for decompressing the demultiplexed selected video signals; and a video frame buffer for receiving 
and delaying play of a received video signal whereby a seamless switch to a further video signal may be directed by 
said processing means at a predetermined, video switching time, the further video signal selected and the predeter- 
mined video switching time of the selection being a function of the branching codes; and display means for displaying 

35 the selected video signal; and wherein the display means is additionally arranged to display graphics signals extracted 
by said demultiplexer as directed by said processing means; and the viewer reception system further comprising: an 
audio switch connected to the demultiplexer for selecting and receiving a specific audio signal as directed by said 
processing means, whereby a switch to a further audio signal may be directed by said processing means at a prede- 
termined, audio switching time, the further audio signal selected and the predetermined audio switching time being a 

40 function of the branching codes; and means for playing the audio signal selected. 

[0007] A receiver of an embodiment of the invention enables the viewer to actively participate in selecting digital 
video streams, associated with different camera angles, for example, and also to select audio and/or graphics seg- 
ments. In addition, web pages from Internet web sites can be integrated into the program. 

[0008] Embodiments of the invention are particularly suited for the broadcasting of live events, such as sporting 
45 events. The viewer can appear to direct the camera shots by instantly changing among various camera angles, choose 
player interviews, or display associated statistical data on the team or players via graphics. In this manner, the system 
allows the individual subscriber to act as if he or she has control over how the program is directed and presented on 
their personal television set. In addition to selecting different camera angles, various audio options, closeups, slow 
motion, replays, graphics overlays, graphics or audio from web sites, etc., are all possible. Further, games may be 
50 integrated with the live sports programming to increase viewer interest. 

[0009] Thus, viewers can customize the content of programs. The interactive digital programming of the present 
invention is particularly advantageous for viewing live sporting events. Viewers are not limited to selecting from multiple 
camera angles, but may also call up player statistics on demand, for example. Cameras may be focused on different 
segments of an event. Further, video options may include video replay, slow motion effects, isolation on a particular 
55 player or group, etc. Changes are seamless, thereby adding to the effect that the viewer is directing the television show 
just as a director now does from a control room. In addition, with the invention, the viewer may also select the audio 
to accompany the video displayed. For example, the viewer may listen to a commentary in a selected language, or 
may substitute player interviews, for example, for the commentary. 
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[0010] This "director" role by the viewer is possible due to the interactive technology described herein and is also 
due to the digital compression and transmission scheme which allows for much greater information throughput over a 
given bandwidth, allowing viewers to choose from angles that are already available but presently cut by the director. 
[0011] The digital interactive system is based upon branches which occur in the course of the full-motion video. 
5 Branches are real-time parallel paths that may be other full-motion video segments, graphics which are integrated into 
the video, audio segments, and/or retrieved web pages. 

[0012] Sometimes, the interactive digital system will act upon the viewer's response immediately; other times, it will 
utilize ACTV's unique "profiling" concept to act upon the response later. This technology enables the system to "re- 
member" the viewer's responses and desires, and integrate them into the video, audio, graphics and/or web site infor- 

10 mation at a later point. For example, the viewer could specify at the beginning of a football game to isolate the offensive 
quarterback of a particular team. Thus, whenever the team of choice is on offense, the video isolation of the quarterback 
is displayed to the viewer automatically. Or, based on how a viewer has selected camera angles, replays, etc., over 
the past five minutes, the system acts to mimic these selections at later times during the program. The systems de- 
scribed herein may "learn" from the viewer how they want to view the game, and then continue viewer selection se- 

15 quences made earlier. 

[0013] In another aspect, the present invention provides a system for providing interactive digital programming, com- 
prising: means for receiving video signals from a plurality of video cameras, one or more of the cameras relaying a 
different predetermined view of a live event, the video receiving means also receiving prerecorded video signals; means 
for receiving audio signals corresponding to the live event, the audio receiving means also receiving prerecorded audio 

20 signals; means for generating one or more graphics signals; at least one digital compression device connected to the 
video receiving means, the audio receiving means, and said generating means, for digitally compressing the video, 
graphics and audio signals; processing means connected to the compression device, for creating a set of data com- 
mands corresponding to the audio, graphics and video signals, the data commands including branching codes; a digital 
multiplexer connected to the digital compression device, for multiplexing the video, graphics and audio signals, and 

25 the data commands into a combined digital program stream; and means for transmitting the combined digital program 
stream. 

[001 4] In an embodiment, each of the video cameras may relay a different predetermined view of an event. Preferably, 
the combined digital program stream is formed at a central control studio. After receiving the video, audio, and graphics 
signals at the central control studio, these signals are digitized and compressed in digital video and audio compressors. 
30 These signals are then combined with the special data codes into the "digital package," and subsequently, transmitted, 
for example, over a cable distribution system. The special data codes are the keys to unlocking the interactive potential 
of the program. 

[0015] The invention also extends to a method for providing interactive digital programming, comprising the steps 
of: obtaining video signals from a plurality of video cameras, one or more of the cameras relaying a different view of a 

35 live event; obtaining prerecorded video signals; producing one or more audio signals corresponding to the live event; 
obtaining prerecorded audio signals; creating one or more graphics signals; digitally compressing the video, graphic 
and audio signals; producing a set of data commands which correspond to the audio, graphics and video signals, the 
data commands including branching codes; digitally multiplexing the video, graphics and audio signals, and the data 
commands into a combined digital program stream; and transmitting the combined digital program stream. 

40 [0016] The digital program signals are transmitted to a receive site by any suitable transmission means. Once re- 
ceived by a receive antenna, the digital program signals are passed along a digital cable television distribution system 
to the viewer homes. Further, some other signals or commercials can be inserted at the local head end. The signals 
are received and processed in a digital cable box. Selections of the video, audio, graphics display and/or web pages 
may be made as a function of immediate viewer entries, or to interrogatory responses presented at the beginning or 

45 during the program, or based on a prestored viewer profile. Once a decision is made to switch from one video option 
to another video option, the digital switch is performed seamlessly. 

[0017] As mentioned above, the program at predetermined times or immediately upon user entry may retrieve and 
branch to informative segments from web sites. For example, a viewer watching a sporting event may receive a stream 
of web pages which provide additional, specific information relating to a favorite player, team or perhaps the remaining 
50 schedule for the sports team, as examples. In addition, users may take advantage of the two-way capabilities of the 
Internet to respond to polls or to link to additional sites. 

[001 8] Another Internet-based application allows advertisers to speak more directly to consumers by directly sending 
web pages to the consumer instead of merely displaying web addresses in their commercials. The particular advertising 
information from web sites may be targeted to viewers based on the viewer profile, stored either in the digital set top 
55 box or at the cable head end. Alternatively, web site access may be initiated by the viewer by simply clicking on the 
remote during the commercial. Thus, the viewers have the capability to individually select web sites if they want more 
information from advertisers. 

[0019] The video programming and corresponding Internet pages may be viewed on personal computers equipped 
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with a television card, on special digital cable boxes with stored interactive Internet application software providing 
Internet access, or on digital television sets. 

[0020] According to a further aspect of the present invention there is provided a method for receiving interactive 
programming, the live interactive programming comprising a plurality of digitally compressed video, audio, and graphics 

5 signals and branching codes, the method comprising the steps of: selecting one of the video signals and directing a 
seamless switch to the selected video signal at a first predetermined time, the selection of the video signal and the 
first predetermined time of the selection being a function of the branching codes; selecting one of the audio signals 
and directing a switch to the selected audio signal at a second predetermined time, the selection of the audio signal 
and the second predetermined time of the selection being a function of the branching codes; demultiplexing the selected 

10 video and audio signals; decompressing the demultiplexed selected video and audio signals; displaying the selected 
video signal; and playing the selected audio signal. 

[0021] Methods and systems of the invention also have application for other types of programming. For example, 

viewers can direct the scenes of a murder mystery. Switching from one scene to another can be done seamlessly 

without noticeable effect on the viewer. The invention may be utilised whether the television event is live or pre-recorded. 
15 For instance, a music concert or a political convention may be enhanced using techniques described herein. 

[0022] Embodiments of the present invention will hereinafter be described, 

by way of example, with reference to the accompanying drawings, in which:- 

[0023] Figure 1 is a diagram of the network and equipment for providing interactive digital programming. 

[0024] Figure 2 is a block diagram of an interactive digital cable box of the present invention. 
20 [0025] Figure 3 is a block diagram of a dual-tuner interactive digital cable box allowing seamless switching between 

video signals. 

[0026] Figure 4 is a block diagram of another interactive digital cable box allowing seamless switching between video 
signals. 

[0027] Figure 5 is a time diagram showing a representation of trigger points and corresponding video, audio and/or 
25 graphics segments, one or a combination of which are selected for presentation to the subscriber immediately after 
the execution of the trigger point function. 

[0028] Figure 6 is a block diagram of an alternative embodiment of an interactive system including internet access. 
[0029] Figure 7 is a block diagram of a two-way configuration of the system. 

[0030] There is described and illustrated herein, an interactive digital system 1 for producing a personalized program 
30 allowing the home viewer an expanded set of programming options. Digital TV steams are put into digital packages 

made up of video, audio, data codes and graphics, and are used to provide personalized responses to viewer selections. 

Such responses may be further enhanced by allowing access to Internet Web sites 170. In this manner, sports such 

as golf, football, baseball, basketball, etc. can be watched with greater interest and involvement. 

[0031] As shown in Figure 1, several possible video streams are gathered by way of cameras 100, strategically 
35 located at a sporting event 10, for example. In this respect, although the invention is described below with specific 

reference to the viewing of a live sporting event, it will be appreciated that the invention has many possible uses and 

the reference to a live sporting event is by way of example only. The present invention is not limited to use with live 

sporting events. 

[0032] Currently, many cameras 100 are employed at a sporting event 10. Super Bowl coverage, for example, typ- 
40 jcally encompasses 25 to 30 cameras. These live video streams can be integrated with recorded video streams which, 
for example, may include highlights from the current game or past games, player profiles, etc. 

A. The Control Studio 

45 [0033] The interactive broadcast program is prepared at the control studio 5 into digital packages. The control studio 
5, as shown in Figure 1 , allows a producer to create and introduce interactive elements during a live broadcast. In one 
preferred embodiment, the producer pre-records a set of interrogatories or instructions for the user. These interroga- 
tories may include such questions as the following: 

SELECT THE CAMERA ANGLES/OPTIONS THAT YOU PREFER: 

50 

OPTIONS: END-ZONE 

FIFTY YARD LINE 
FOCUS ON THE QUARTERBACK 
FOCUS ON THE DEFENSE 
55 FOCUS ON THE CHEERLEADERS 

PROVIDE HIGHLIGHTS 

WHO IS YOUR FAVORITE TEAM IN THE GAME? 
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OPTIONS: BLUE TEAM 
RED TEAM 

WHO IS YOUR FAVORITE PLAYER IN THE GAME? 

5 

OPTIONS: RED RUNNER 

BLUE QUARTERBACK 
BLUE DEFENSIVE END 
RED QUARTERBACK 
10 ETC. 

ARE YOU INTERESTED IN RECEIVING STATISTICAL SUMMARIES? 
WOULD YOU ENJOY LISTENING TO PLAYER INTERVIEWS DURING THE GAME? 
[0034] Such interrogatories can be presented to the viewer at the beginning of the broadcast or scattered throughout 

15 the program. Interactive responses to such interrogatories would include video, audio and graphics personalized to 
the particular viewer. The preparation of the graphics for presenting such interrogatories occurs off-line at the control 
studio 5 using chyron or any graphics language. These interrogatories or instructions will ultimately be displayed to 
the home viewer, preferably in the form of graphics, to facilitate the interactive responses. The producer creates these 
graphic video slides of questions on a computer using the text editor and chyron. Associated with each question, the 

20 producer enters a number of possible viewer options. Then, the producer relates each possible user entry to one or 
more corresponding interactive responses. If the response is information from an Internet Web page, the producer will 
indicate the particular Uniform Resource Locator (URL) of the Web page. The producer sets a time stamp for when 
each particular question will appear during the program. As explained below in more detail, the viewer response to a 
query will be used to direct which video (and/or audio, graphics, or Web page) option will be provided to the viewer. In 

25 the present invention, the interactive response to the query can occur immediately following the entry of the viewer 
entry or at some predetermined later time in the program using "trigger points," 500 as explained in detail below. 
[0035] With respect to the video segments, cameras 1 00 are preferably trained on different segments of the sporting 
event 1 0. As is common with broadcasts of a football game, for example, cameras 1 00 could be located in the endzone, 
press box, the field and at various other locations throughout the stadium. Further, various video options can be created 

30 including video replay, slow motion, isolation on cheerleaders, particular player or group of players. Instant replays are 
created by delaying the live feed for a certain number of seconds. These video streams are sent to a control studio 5. 
The control studio 5 contains the necessary equipment for packaging the program for delivery to the viewers. The 
studio 5 contains a video switcher 105 which receives the live signals from the cameras 100 by way of various input 
lines. Further, lines carrying recorded video streams from one or more VCRs 110, computers or CD players feed into 

35 the video switcher 105. The video switcher 105 also receives video inputs from the control computer 135. Further, 
various graphics screens, depicting, for example, sports team or player statistics can be designed with the control 
personal computer 135 and forwarded to the digital video switch 105. The producer, via the control PC 135, directs 
which video options to pass through the video switcher 1 05. At the output of the video switcher 1 05, each of the different 
output video streams access a separate encoder 125 and are all GENLOCKED, so that each video stream is synchro- 

40 nized with the other video streams. 

[0036] After encoding, the video streams are input into a video compressor 125. Preferably, the digital compression 
scheme is MPEG-2. Preferably, 64 Quadrature Amplitude Modulation (QAM) is used as the modulation scheme. In 
this digital embodiment, four channels of digitally-compressed video content would carry about 27 Mbps using 6 MHz 
of bandwidth. Alternatively, if 256 QAM is employed, seven-to-one video compression can be achieved with the MPEG- 

45 2 scheme. While MPEG-2 is the preferred compression scheme, the signals can be compressed according to any 
known standard including MPEG-1 , JPEG, or other DCT coding scheme, wavelets, fractals or other transform or wave- 
form based technique. 

[0037] The control studio 5 also contains an audio switcher 1 1 5 which receives live audio signals from microphones 
or recorded audio from tape players 120, CDs, VCRs 110, etc.. The control computer 135 sends commands to the 

50 audio switcher 115 directing which audio options should pass through the switch 115. Further, in the audio switcher 
115 the various audio signals can be aligned to match the various video signals in time. In addition, VCR audio output 
is received by the audio switcher 1 1 5. The present invention can accommodate any number of audio signals as output 
from the audio switcher 115, as directed by the producer. The audio outputs are received by an digital audio encoder/ 
compressor 1 30. The audio signals are then preferably sampled, encoded and compressed in the digital audio encoder/ 

55 compressor 130. The encoding technique can be a waveform coding technique such as PCM, ADPCM or DM. Alter- 
natively, the signals can be encoded using synthesizer or vocoder techniques such as MUSICAM, Linear Predictive 
Coding (LPC), Adaptive Predictive Coding (APC), and Sub-band coding. Generally, the transmission rate is about 256 
kbps per audio for the stereo pair. 
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[0038] The timing and control for integrating the various multimedia elements is provided by the ACTV authoring 
language, a unique set of interactive data codes to facilitate the interactive process. The data codes are stored in 
memory in the control computer 1 35 as part of the ACTV programming language. The codes comprise commands, or 
branch codes, for branching between interactive options, timing signals for controlling the interactive program, data or 
5 text, commands for termination and initiation or interactive program viewing, or triggers for executing macros. Prefer- 
ably, these commands are output from the control computer 135 and multiplexed with the video streams in the MPEG- 
2 compressor 1 25, as shown in Figure 1 . Interactive options that can be branched to based on the branch codes include 
video segments, audio segments, graphics segments and/or identified Web pages. 

[0039] There are several commands in the ACTV authoring language that function to provide the interactive sports 
10 programming applications. These commands are explained below in Section D, which details programming applica- 
tions. 

B. The Transmission System 

15 [0040] As shown in figure 1, the digital interactive system 1 uses an interactive program delivery system with any 
transmission means including satellite 1 5, cable 1 50, wire or television broadcast 1 75 to deliver the interactive program 
(hereinafter "composite interactive program") from the control studio 5 for distribution to subscribers in their homes. At 
the control studio 5, the signals from the digital multiplexer 140 are converted to RF and distributed to a microwave 
175, cable 150 or satellite 15 network. Preferably, the digital interactive signal is forwarded from the control studio 5 

20 to a cable headend 150, and subsequently, sent to the homes via the cable network. 

[0041] The program is preferably the broadcast of a live event. For example, live sporting events with added inter- 
active elements can be broadcast from the control studio 5. Such live interactive elements could be different camera 
angles 100, slow motion video, etc., as discussed above, while also incorporating prerecorded interactive segments 
such as highlights. Alternatively, the program can be produced off-line and stored in a program storage means at the 

25 control studio 5. 

[0042] In a satellite broadcast transmission, the digital interactive signals are transmitted to uplink equipment where 
they may be multiplexed, upconverted, modulated, amplified and transmitted by satellite 15 to the receiver site 155 for 
distribution to the homes. 

[0043] At the reception end, the composite digital interactive signals enter a receiver 155 where the signals are 
30 demultiplexed, downconverted, demodulated and then passed to a cable distribution system that directs the signals 
to the homes. Although a cable distribution system 150 is the preferred transmission media to the homes, the digital 
signals may also be distributed by any conventionally known technique including satellite 1 5 to digital satellite receivers 
155 at the home, fiberoptics, low or high power broadcast television 175, telephone lines, cellular networks, and similar 
technology can be used interchangeably with this program delivery system. 

35 

C. The Interactive Digital Box 

[0044] The interactive digital box 25 is shown schematically in Figure 2. Preferably, the interactive digital box is a 
specially adapted digital cable box 25. The controller 260 determines what video, audio, graphics and/or Web pages 

40 to display based upon the interactive commands which it receives. Based upon the commands, it plays the appropriate 
video, audio, graphics or Web page options. The graphics can either be created and sent from the control studio 5 or 
the graphical images can be created at the interactive digital box 25 based on instructions preferably in the interactive 
commands. The interactive digital box 25 connects to a television 1 65 or other display monitor. Further, the interactive 
digital box 25 can be connected to a digital television 1 95, in which case an RF modulator 245 is not necessary. Each 

45 downstream transmission reaches the subscriber's house, shown in Figure 2, preferably through a tap and drop cable. 
[0045] The user interacts with the program through the input device 20. Preferably, the input device 20 is a typical 
television remote. The user interface 270 may be an infrared, wireless, or wired receiver that receives information from 
the input device 20. 

[0046] Regardless of the type of input device 20, user inputs can be utilized by the present invention immediately, 
50 or at a later time, to result in personalized graphics, video and/or audio presentation. For example, the present invention 
utilizes "trigger points," 500 as described below, to enable subsequent branches among multimedia segments during 
the show. 

[0047] Certain commands are sent from the control studio 5 as part of the digital interactive programming to facilitate 
the collection of user entries. These commands are extracted at the digital demultiplexer 21 0 and sent to the controller 
55 2 60 which performs the appropriate action based on the commands. Some of these commands are explained below. 

a. BEGIN INPUT EXTENDED 

The Begin Input command starts an input period during which the user may press one or more buttons to 
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select his or her choice(s). The entry format of this command is set forth as follows: 
BEGIN INPUT {{N} {VALID KEYS} {DIFFERENT} {FEEDBACK} 

where: 

5 N The maximum number of keys that can be pressed. 

KEYS The valid keys that can be pressed. 

DIFFERENT Requires each key pressed to be different. 
FEEDBACK The feedback type provided to the viewer. 

10 b. BEGIN VIDEO CHOICE EXTENDED 

The Begin Video Choice begins an input period for disco mode. During disco mode, the video switches dy- 
namically each time the viewer makes a selection. 
BEGIN_VIDEO_CHOICE MODE [KEYS] {FEEDBACK [AUDIO]} 

The disco mode allows the viewer to change channels at will, while the OneShot mode allows only one change 
15 of channel. 

MODE DISCO/ONESHOT 

KEYS The valid keys that can be pressed. 

FEEDBACK The feedback supplied to the user for the key(s) which are pressed. 

20 

The mode Disco allows the viewer to change channels at will, while the OneShot mode allows only one change 
of channel. 

c. BEGIN AUDIO CHOICE EXTENDED 

25 The Begin Audio Choice begins an input period for disco mode. 

BEGIN_AUDIO_CHOICE MODE [KEYS] {FEEDBACK [AUDIO]} 

MODE DISCO/ONESHOT 
KEYS The valid keys that can be pressed. 

30 FEEDBACK The feedback supplied to the user for the key(s) which are pressed. 

d. MAP 

The Map command is used to map video or audio tracks to keys, for use in connection with the Begin Audio 
Choice and Begin Video Choice commands. If this command is omitted, Key 1 will map to Track or Channel 1, 
35 Key 2 to Track or Channel 2 etc. This command allows mapping any key to any channel. 

MAP KEYS [TRACKS [T1 ,...TN/T1-TN] CHANNELS [C1 ,...CN/C1-CN]] 

The map statement maps audio tracks or video channels to keys, to enable audio or video choice commands 
to effect changes to tracks other than the default tracks, which are that key 1 maps to track 1 , key 2 to track 2, 
etc.. All the choice statements after a map statement will cause the tracks, video tracks or channels to be changed 
40 to those specified in the map statement. The acceptable numbers for the map command are from 1 to 8, for keys, 

video channels and audio channels. 

[0048] Other commands include those which allow for the following applications: 

(1) viewer profiling, to enable the set top box 25 to "remember" viewer preferences; (2) uploading viewer responses 
45 to a central location; (3) downloading of text and graphics, for display using the graphics chip of the set top box 25; (4) 
the ability of the viewer to prepare his own video, based upon his selections of camera shots 100 and audio, which 
can be stored and replayed for the viewer. 

[0049] The interactive digital box 25 of the present invention enables seamless flicker-free transparent switching 
between the digital video signals. "Seamless" means that the switch from one video signal to another is user imper- 
50 ceptible. Because the video signals are running off the same clock, the interactive digital box 25 is capable of providing 
a seamless digital switch from one video signal to another signal. The program clock reference necessary for the box 
to make this seamless switch is preferably embedded in the signal header. 

[0050] As shown in Figure 2, a CPU 260 is connected to an RF demodulator 200 and digital demultiplexer 21 0. The 
CPU 260 directs demodulation and demultiplexing of the proper channel and data stream to obtain the correct video 
55 signal. Seamless switching can occur with MPEG-2 compressed signals since there are points within the frame wherein 
seamless switching can occur. Preferably, switches occur at an "I" frame, assuming the use of MPEG-2 compression. 
The selected video signal is determined either by examination of the user's input from user interface 270 and/or any 
other information or criteria (such as personal profile information) stored in RAM/ROM 265. For example, the RAM/ 
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ROM 265 could store commands provided within the video signals as discussed in U.S. patent no. 4,602,279. 
[0051] The RF demodulator 200 demodulates data from the broadcast channel directed by the controller 260. After 
the data stream is demodulated, it passes through a forward error correction circuit 205 into a digital demultiplexer 
210. The demultiplexer 210 is controlled by the controller 260 to provide a specific video signal out of a number of 

5 video signals which may be located within the data stream on the demodulated broadcast channel. The demultiplexed 
video signal is then decompressed and decoded by decompressor/decoder 215. The video signal is synchronized by 
a sync add circuit 220 and a sync generator 225. The video signal is then buffered by a video frame buffer 230. The 
buffered video signal is modulated by a modulator 245 into a NTSC compatible signal. Such a modulator is not nec- 
essary if the selected signal is sent to a digital television 195. 

w [0052] By using a video frame buffer 230 and delaying the viewing of a given signal, enough time is allowed for the 
decompressor/decoder 215 to lock onto, decompress, convert to analog, and wait for the resultant vertical interval of 
a second video signal. For example, assume video signal A is currently being processed and transferred through the 
circuit shown in Figure 2 and displayed. Based upon a user selection, the controller 260 directs the digital demultiplexer 
210 and RF demodulator 200 to switch to another video signal, video signal B. To accomplish this, the analog video 

15 from the first digital video signal, video signal A, complete with video sync, is fed into video frame buffer 230. This 
buffer 230 can hold the full video picture for "n" number of frames after which the signal is output to the display. In 
effect, a delayed video signal A is viewed "n" number of frames after the signal has been received. When the user 
selects a different video path by means of pressing a button on a keypad or entry by other means, the controller 260 
instructs the digital demultiplexer 210 to stop decoding signal A and lock onto signal B to begin decoding signal B 

20 instead of signal A. 

[0053] While this is happening, even though the decompressor/decoder 21 5 is no longer decompressing video signal 
A, the display is still showing video signal A because it is being read from the buffer 230. As soon as decompressing 
and decoding occurs, the controller 260 looks for the next vertical blanking interval (VBI) and instructs the video frame 
buffer 230 to switch to its input, rather than its buffered output at the occurrence of the VBI. 

25 [0054] Since the RF demodulator 200, forward error corrector 205, digital demultiplexer 210, and decompressor/ 
decoder 215 require a certain time period to decompress and decode the video signal B frame from its data stream, 
the size of the buffer 230 has to be large enough so that this processing can take place without interruption during the 
switching of the video signals. If desired, the system may continue to use the buffer in anticipation of a future switch. 
By using the controller 260 to manipulate the fill and empty rate of the buffer 230, the buffer 230 may be rapidly filled 

30 with video signal B frames and then after a period of time will be reset and ready to make another switch to another 
video in the same manner. The buffer 230 may also be reset by skipping frames or providing a delay between sequential 
frame outputs for a short time in order to fill the buffer 230. If a delay is used to maintain video signal or frame output 
while the buffer 230 is being filled, a slight distortion may occur for a brief amount of time. 

[0055] Because a first video signal is always displayed as the output of the buffer 230 after the delay, the buffered 
35 video masks the acquisition and decoding of a second video signal. As long as the buffer 230 is large enough to keep 
the first video running while the second video is being decompressed and decoded, a seamless switch will occur. 
[0056] While the digital interactive box 25 of Figure 2 provides video interactivity, audio and/or graphics interactivity 
is also provided. For example, if, based on the viewer profile or viewer response to query, it is determined that the 
viewer's primary language is Spanish, then that viewer could obtain Spanish commentary to the football, soccer, etc. 
40 game. Alternatively, if a viewer has a favorite athlete, the audio can switch to an interview with the athlete during a 
segment of the broadcast. Multiple digital audio options forming a set of suitable responses to an interrogatory message 
can be sent as part of the composite digital signal. As set forth in U.S. patent no. 5,585,858, 

there are a number of different ways to effectively forward the necessary audio options for a given live event to the 
digital interactive box 25. With the present invention, it makes no difference how the audio options reach the digital 

45 interactive box 25, as long as they are available for selection and play at the appropriate times. 

[0057] In Figure 2, the digital demultiplexer 210 extracts the digital audio signal(s) and forwards them to the audio 
switch 250. Additional audio options are available from the digital audio memory 255. At certain times during the pro- 
gram, the data codes will identify the selection of a particular audio option corresponding to previous user inputs. The 
controller 260 calls the appropriate audio options from internal memory 255 or directs the audio switch 250 to select 

50 a predetermined audio segment received as part of the received digital signal for passage to the RF modulator 245 
for play to the subscriber. At the end of the audio segment time period as indicated by the data codes, the controller 
260 instructs the audio switch 250 to again pick up standard audio. 

[0058] The digital demultiplexer 210 sends the extracted graphics data or ACTV data codes to the controller 260. 
The controller 260 interprets the extracted data as either control data, including instructions for switching between 
55 video signals, audio signals, or graphics data for on-screen display, if the data is on-screen display data, the data is 
preferably prefixed by a command designating the data as on-screen display data, as opposed to control data. Further, 
the controller 260 also examines the control data for the occurrence of a header code designating the onset of a trigger 
point 500 in the program, explained below. 
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[0059] Figure 3 shows an alternate, dual tuner embodiment for seamless switching between separate video signals. 
This embodiment presumes that two 6 MHz channels are used, each of which comprises compressed digital video 
and audio streams. In this embodiment, the microprocessor 260 controls the selection of the RF channel that is de- 
modulated by RF demodulators 200A, 200B. The demodulated data streams enter the forward error correctors 205A, 
5 205B. At the output of the forward error correctors 205A, 205B the data streams are transmitted to the input of the 
digital demultiplexers 21 OA, 21 OB. 

[0060] As with the RF demodulators 200A, 200B, the digital demultiplexers 21 OA, 21 0B are controlled by the micro- 
processor 260. This configuration allows the microprocessor 260 to independently select two different individual time- 
multiplexed video signals on different channels and data streams. If all the video signals of an interactive program were 
10 contained on a single channel or data stream, it would only be necessary to have a single RF demodulator 200, forward 
error corrector 205, and digital demultiplexer 21 0 serially connected and feeding into the two digital video buffers 230A, 
230B. 

[0061] Two data streams are provided from the digital demultiplexers 21 OA, 21 0B One data stream carries video 
information pertaining to the video signal the user is currently viewing. The second data stream carries the video signal 
15 selected based on the user's previous and/or current interactive selections from the user interface 270, as determined 
by the microprocessor 260. 

[0062] The digital information on each of the two streams is buffered in digital video buffers 230A, 230B. The buffered 
signals are then decompressed and converted into analog signals by decompressors/decoders 21 5A, 21 5B which 
include digital to analog converters. The decompressors 21 5A, 21 5B are preferably MPEG-2 decoders. 
20 [0063] A local sync generator 225 is connected to sync add 220A, 220B and frame sync 380A, 380B circuits. Because 
both streams are synchronized based on signals from the same local sync generator 225, each stream becomes 
synchronized to the other. In particular, the signals on each stream are frame synchronized. 

[0064] A vertical blanking interval (VBI) switch 335 is connected to the microprocessor 260 so that the input may be 
switched during the vertical blanking interval of the current stream, resulting in a seamless switch to the viewer. 

25 [0065] The embodiment of Figure 3 operates as follows. Based on user responses and control codes, it is assumed 
that the microprocessor 260 determines that a switch from video signal A to video signal C should be performed. The 
RF demodulator 200A and digital demultiplexer 21 OA are processing the currently viewed video signal, video signal 
A, which is progressing through the upper branch components. A command is issued from the microprocessor 260 to 
the RF demodulator 200A, 200B commanding a switch to the channel and data stream on which video signal C is 

30 located. The microprocessor 260 also instructs the digital demultiplexer 21 0B to provide video signal C from the re- 
ceived data stream to digital video buffer 230B. 

[0066] At this point, the upper RF demodulator 200A and digital demultiplexer 21 OA are still independently receiving 
and processing video signal A, which continues through the upper branch of the circuit. 

[0067] At a certain point, the digital decompressor/decoder 21 5B in the lower branch will begin filling up with video 
35 signal C frames. After video signal C is decompressed and decoded, it is converted into analog. A local sync generator 
225 inserts both local sync and frame sync to video signal C via sync add circuit 220B and frame sync circuit 380B in 
order to synchronize it with the currently displayed video signal A, which is still being provided from the upper digital 
video buffer 230A. At the appropriate switch point, triggered by programming codes supplied with each video signal A 
and C, the microprocessor 260 directs the VBI switch 335 to switch in the vertical blanking interval from video A to 
40 video C, at which time video C will then seamlessly appear on the computer screen. 

[0068] Digital video buffers 230A, 230B may be used in the circuit of Figure 3, but are optional. However, in an 
alternative embodiment the buffers would be required to provide a seamless switch if the Figure 3 circuit was modified 
to incorporate a single RF demodulator 200, single forward error corrector 205, and single digital demultiplexer 210, 
each with a single input and single output. In this alternative embodiment, the circuit cannot independently receive and 
45 demultiplex two data streams on different frequency channels. One buffer 230A is used to store previously received 
video signals, while the other buffer 230B quickly passes through the selected video signals. 

[0069] Based on the same assumptions above, video signal A is progressing through the upper branch of the circuit 
and it is desired to switch to video signal C. However, in this alternative embodiment, the digital video buffer 230A is 
providing maximum buffering to video signal A. 

50 [0070] Because it is desired to switch to video signal C, the microprocessor 260 directs the alternative circuit (con- 
taining a single RF receiver 200, single forward error corrector 205 and single digital demultiplexer 210 connected in 
serial), to receive and demultiplex the data stream on which video signal C is located, which may be different than that 
of video signal A. When video signal C is demultiplexed, the microprocessor 260 directs the digital video buffer 230 to 
provide minimum buffering of video signal C so that decompressor/decoder 215 may quickly decompress and decode 

55 the digital signals. After decompression and decoding, video signal C is synchronized with video signal A. At this time, 
video signal A is read for display from digital video buffer 230A. The upper digital video buffer 230A must be large 
enough to provide video frames for output during the time it takes the RF demodulator 200 and digital demultiplexer 
21 0 to switch to video signal C and the time required for decompression, decoding, and synchronization of video signal 
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C. 

[0071] When video signal C is synchronized with video signal A, the microprocessor 260 directs VBI switch 335 to 
switch from video signal A to video signal C in the vertical blanking interval of video signal A, thereby providing a 
seamless and flicker-free switch. 
5 [0072] At this time, digital video buffer 230 will begin to utilize maximum buffering by altering its fill/empty rate as 
described above with respect to the Figure 3 embodiment. When adequate buffering is achieved, a switch to another 
video signal may be performed in the same manner as described above. 

[0073] Another preferred embodiment is shown in Figure 4. This embodiment also includes an RF demodulator 200, 
a forward error corrector 205, and a digital demultiplexer 21 0. However, the circuitry differs along the rest of the chain 

10 to the television set or monitor. In this embodiment, a memory 475 is incorporated and connected to the output of the 
demultiplexer for storing the compressed composite digital video signal. The decompressor/decoder 215 is inserted 
at the output of the compressed memory. The decompressor/decoder 215 decompresses the digital signal, converts 
the signal to analog and forwards the analog signal to the RF encode 245 for transmission to the monitor. Once the 
composite compressed digital video signal is fed into the compressed memory 475, the microprocessor 260 directs a 

15 pointer to be placed somewhere along the compressed digital video signal. Based on the placement of the pointer, 
different frames and different segments of the composite digital video signal will be read from memory 475 for decom- 
pression and decoding. 

[0074] The different video signals are distinguished from one another because they are labeled, preferably by head- 
ers. Assuming that video signal A has been selected for play on the monitor, the compressed digital memory 475 fills 

20 up with A frames. Assuming a switch to video signal C is desired, the microprocessor 260 directs the RF demodulator 
200 and digital demultiplexer 21 0 to begin filling the compressed memory 475 with video C frames. The decoder 215 
pointer begins to move down. As soon as a sufficient number of C frames have entered the compressed memory 475, 
the pointer will then jump to the beginning of the C frames. The C frames are then output into the decompressor/ 
decoder 215 where the digital frames are converted into an analog signal. 

25 [0075] The digital video is multiplexed in a series of easily identifiable packets. These packets may contain full com- 
pressed frames of video (I frames) or may include only the differences between full frames (B frames or P frames). 
[0076] To be able to reconstruct the full video images, the decompressor/decoder 215 needs to have a minimum 
number of I, P and B frames. The decoder 215 needs only one I frame to decode an image. Conversely, two prior 
Anchor frames (Ts" and "P's") are necessary to decode B frames. In order to decode P frames, the decoder 21 5 only 

30 needs one Prior Anchor frame. When the microprocessor instructs the digital demultiplexer 21 0 to start sending packets 
from a different data stream there is no way to be certain that the next packet will be an I packet needed for decoding 
the second video stream. To avoid a breakup of the video images, which would occur if the decompressor/decoder 
215 suddenly started receiving packets unrelated to the stream it was decoding, the microprocessor 260 starts to fill 
up the memory 475 with video signal C packets until it is determined that a full sequence of I, B and P frames are 

35 available. The decoder 215 should receive the last bit of the last B frame in a given, GOP (Group of Pictures) before 
the switch, in order to prevent glitches when decoding. Furthermore, the last B frame of the GOP must only be backward 
predicted, not forward predicted or bidirectional predicted. As soon as the valid sequence is in memory 475 the micro- 
processor 260 moves the memory read pointer to the start of a valid sequence of C video signal packets so that the 
decompressor/decoder 21 5 can successfully decode the C signals. This results in a seamless switch from video signal 

40 A to video signal C. 

[0077] This embodiment requires a data channel for enabling a synchronous switch between a first video stream 
and a second video stream. This data channel comprises the ACTV codes which link together the different program 
elements and information segments on the different video signals. In addition, the data channel also comprises syn- 
chronization pulses and a time code to signify to the pointer the proper time to skip from a memory location representing 
45 one video signal to a memory location representing another video signal in order to enable a seamless switch. 

[0078] The microprocessor 260 reads the data signal from the digital demultiplexer 21 0 and communicates pertinent 
data to the sync add circuit 220, which is connected to sync generator 225. The microprocessor 260 is then able to 
synchronously communicate with the memory 475. 

[0079] The time code sent will identify the timing for one picture, as well as for multiple pictures, and will lock the 
50 different pictures together. This is done through the use of similar clocks at both the transmission end and the receiver. 
A time code is used in order to keep the two clocks at both the transmission and receive end synchronously connected 
to one another. Once the clocks at both ends are working synchronously, each of the multiplexed video streams must 
be synchronized to the clocks. In order to synchronize the multiplexed video stream to the clocks, each of the individual 
channels must be referenced to a common reference point and must be identified. 
55 [0080] In the preferred embodiment, a packet header would be incorporated into the transport layer of the MPEG 
signal to identify the various channels. The packet header will also include information as to where to insert the vertical 
blanking interval. In MPEG, the vertical blanking interval is not transmitted from the headend. Therefore, the vertical 
blanking interval must be generated locally. The packet header eye will identify at what time the vertical blanking interval 
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is in existence in order to effectuate a seamless switch between analog pictures. 

[0081] In summary, the combination of clock and the information embedded in either the transport layer of MPEG or 
in a separate packet on a separate data channel effectuates the linking between each video signal and a corresponding 
time point. The data channel also includes information designating when all the various video signals will be in syn- 
5 chronism with one another. It is at these points that the microprocessor 260 may direct the pointer to skip from one 
location to another location, at a time (such as during the VBI) when a seamless switch will result. 

D. Trigger Points 

w [0082] Interactivity is further enhanced in the digital interactive embodiments through the application of trigger points 
500 scattered at various predetermined times throughout the program, a timeline representation of which is shown in 
Figure 5. The trigger points 500 correspond to times when interactive events are scheduled to take place during the 
live sporting event 1 0. These interactive events could be the selection and playing of video, audio segments, the display 
of graphics or display of Web pages accessed from Internet Web sites 170. For example, when a viewer's favorite 

15 baseball player is at bat, graphics showing past or current performance statistics of the player can be overlaid on the 
screen while excerpts from an interview with the player can be played for the viewer. While the choice of particular 
video, audio or graphics is still dependent on viewer selections, the viewer selections in response to displayed graphical 
interrogatory messages are preferably made during a period at the onset of the program or when a viewer first tunes 
into the program. Alternatively, interrogatories are not necessary if the switches are based on the viewer profile stored 

20 in memory 265. These viewer selections are then utilized as inputs to macros called up at later times during the program 
by the controller 260 upon the occurrence of the trigger points 500, identified to the interactive computer by unique 
codes embedded in the video signal. 

[0083] The trigger points 500 correspond to the times when the conventional program content can be altered and 
personalized for the viewers. The programmer can place the trigger points 500 at any time throughout the program. 

25 Since the trigger points 500 are unknown to the subscriber, the subscriber does not know when they will receive a 
personalized message. In other words, an interactive response can either immediately follow a corresponding user 
selection made to an interrogatory message or occur at a later time corresponding to a trigger point 500, or any com- 
bination of the two. Of course, timing of the interactive events should correspond to suitable times in the program where 
branching to interactive elements is sensible and does not clash with the program content of the conventional video 

30 still displayed on the television 1 65 or other display monitor. 

[0084] At the onset of a trigger point 500, the controller 260 will select one of several possible audio (or video or 
graphic display) responses for presentation to the subscriber. As mentioned above and shown in figure 5, some of the 
responses may comprise a branch to either a video segment, graphics and/or audio segments. 
[0085] In combination with the use of trigger points 500, the present invention allows for the viewer to select certain 

35 options at the onset of the program to suit the viewers' preferences. For example, if the program broadcast is a live 
sports event 10, at an early trigger point 500, the viewer could be queried as to whether the viewer would prefer to 
receive audio in English, Spanish, French, or perhaps hear the local announcer instead of the network announcer. 
Upon the viewer selection, the CPU 260 directs a branch to the appropriate interactive segment. 
[0086] Each trigger point 500 is identified preferably through the broadcast of ACTV codes sent as part of the com- 

40 posite interactive program signal. The codes preferably include, at a minimum, the following information: (1) header 
identifying the occurrence of a trigger point 500; (2) function ID (e.g., selection of audio or graphics responses, etc.); 
and (3) corresponding interrogatory message(s) or particular viewer characteristic or habit based on viewer profile. 
The first bit sequence simply identifies to the controller that a trigger point 500 is about to occur. The function ID 
designates the macro or other set of executable instructions for the controller 260 to read and interpret to obtain the 

45 desired result, e.g., a selected video and/or audio response. 

[0087] Upon extraction of the codes by the data decoder; the controller 260 reads and interprets the codes and calls 
from memory 265 a particular user selection(s) designated by the trigger point 500 codes. The user selections corre- 
spond to subscriber answers to a series of interrogatory messages preferably presented at the beginning of the pro- 
gram. After obtaining the appropriate user selection(s), the controller 260 reads and performs the executable instruc- 

50 tions using the user selection(s) as input(s) in the macro algorithm. The result of the algorithm is either a selected video 
stream, audio and/or selected graphics response. The video/audio response can be called from memory 265 if it is 
prestored, called from external data storage, or the controller 260 can command the switch to branch to the particular 
video audio stream if the response is broadcast concurrently with the trigger point 500. After the selected video/audio 
response is played to the subscriber, the switch branches back to the standard program, shown at time t s in Figure 5. 

55 [0088] As mentioned above, a series of interrogatory messages are preferably presented when the subscriber begins 
watching the interactive program. These interrogatory messages can be presented in any one of three ways. First, the 
interrogatory messages can be presented as graphics displays overlaid by the interactive computer workstation onto 
a video signal, wherein the graphics data is sent in the vertical blanking interval of the composite interactive signal, or 
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alternatively stored on the hard disk or external storage. Second, the interrogatory messages are presented as graphics 
displays as discussed above, except the graphics data comes from local storage, external datastorage (e.g., CD ROM, 
cartridge, etc.), or a combination of data in the VBI and data called from either local or external data storage. Third, 
graphics data can be presented in the form of user templates stored at the interactive computer workstation. 

5 [0089] User selections corresponding to answers to the n successive interrogatory messages are received by the 
remote interface 270 at the beginning of the show, stored in memory 265 and used throughout the show at the appro- 
priate trigger points 500 to subtlety change program content as the show progresses. Preferably, each interrogatory 
has a set of possible answers. Next to each possible answer will, be some identifier corresponding to a label on a key 
on the user interface. The subscriber depresses the key corresponding to their answer selection. This selection is 

10 decoded by the remote interface 270 and controller 260, stored in memory 265, preferably RAM, and used later as 
required by an algorithm designated at a trigger point 500. 

E. Internet 

15 [0090] In addition to the central studio serving as a source of interactive option responses, the Internet can be used 
as a source of personalized information for interactive responses. 

[0091] As discussed above, the video programming is preferably created at a centralized location, i.e., the control 
studio 5 as shown in Figure 1 , for distribution to subscribers in their homes. Referring to Figures 1 and 6, in a preferred 
method, the operator at the control studio 5 must designate certain Web pages to correspond to one of the program 

20 options, such as audio and/or graphics options, using control PC 135 and URL encoder 600. Instead of encoding the 
actual content of the options at the control studio 5, as with the audio, Web address identifiers, i.e., Uniform Resource 
Locators (U RLs) are encoded and sent as part of the data codes from the control PC 1 35 to the digital multiplexer 1 40. 
After multiplexing, the URLs are sent as part of the program signal 615, as described above. Preferably, the URLs, 
like the various audio and graphics options, have associated time stamps which indicate to the remote digital set top 

25 boxes 25 when, during the video program, to display the particular Web pages addressed by the URLs, the selection 
and display of which is preferably made as a function of viewer responses or viewer profile. 

[0092] Preferably, each digital set top box 25 has an Internet connection 160 created concurrently with the cable 
connection. The Internet connection 1 60 can be via high-speed line, RF, conventional modem. The digital set top box 
25 has Internet access 160 via any of the current ASCII software mechanisms. In a preferred embodiment, in the 
30 interactive digital set top box 25, the digital demultiplexer 210 extracts the URLs along with the other data codes. In 
an alternative embodiment, a local URL decoder 605 at the user site extracts the URLs. 

[0093] In a preferred embodiment, a JAVA enabled browser as well as specialized software for performing part of 
the method of the present invention are installed on the interactive digital set top box 25. The JAVA enabled browser 
allows the interactive digital set top box 25 to retrieve the Web pages and is preferred software, since it is platform 

35 independent, and thus, enables efficient and flexible transfer of programs, images, etc., over the Internet. The special- 
ized software acts as an interface between the video programming and the Internet functions of the present invention. 
The processor and software interprets these URLs and directs the JAVA enabled browser to retrieve the particular 
relevant Web pages, and synchronizes the retrieved Web pages to the video content for display on the television 
monitor 1 65 at the appropriate times. 

40 [0094] In the present invention, the viewer also has the capability to link to a channel website at will. For example, 
if a viewer is interested in purchasing a product described in an advertisement, by merely clicking on a button on their 
remote 20, the producer's Website could be accessed by Internet connection 160 and displayed to the viewer. The 
viewer could then either obtain more information about the product or order the product, if desired. As described above, 
this application is possible by sending the URL associated with the producer's Website to the digital cable boxes 25 

45 as part of the interactive program. Upon selection by the viewer, the web browser, located either in the digital set-top 
box 25 or externally in a connected PC 610, can retrieve the Web pages. The specialized software then synchronizes 
the Web pages for video display. 

F. Memory 

50 

[0095] The interactive digital set top box 25 of the present invention also has the advantage of remembering sub- 
scriber responses and using these responses in choosing a video/audio response, and/or graphics interrogatory mes- 
sage, to present to the student. Memory branching is a technique of the present invention where the algorithm assem- 
bles video/audio responses and graphics interrogatory messages according to the current and previous user inputs. 
55 Memory branching is accomplished by linking video/audio streams and/or successive graphics interrogatory messages 
together in a logical relationship. In this scheme, the interactive digital set top box 25 contains logic (preferably, in the 
software algorithm) and memory 265 to store previous subscriber selections and to process these previous responses 
in the algorithm to control future video/audio stream selection, as well as future graphics message selection. 
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G. Digital Viewer Profiles 

[0096] In a preferred embodiment, the interactive digital cable box 25 can have a "viewer profile" stored in its memory 
265. Alternatively, the accumulated profile of viewer characteristics and/or habits can be stored at the control studio 5 
5 or cable headend. If the profile statistics are accumulated at some central location, they can also be sent to each 
viewer's home. On the other hand, if accumulated in memory 265 at each of the set top terminals 25, the data could 
be sent to the central location for storage and dissemination by way of the digital back channel. Decisions regarding 
personalized advertising and viewing can then be made for a viewer or class of viewers based on the accumulated 
parameters. 

w [0097] The "viewer profile" preferably contains characteristics of the particular viewer at that subscriber location, 
such as sex, hobbies, interests, etc. This viewer profile is created by having the viewer respond to a series of questions. 
Alternatively, the viewer profiles could be created at a control studio 5 and sent to the interactive digital cable box 25. 
This information is then used by the cable box software to create a compendium of the viewer's interests and prefer- 
ences -- i.e., a user profile. The stored user profile would be used in place of the question/answer format, and thus, 

15 dictate the branches to interactive segments of interest to the viewer. 

[0098] Alternatively, the interactive cable box 25 can be programmed to create a user profile of each viewer based 
on the selections made during one of the interactive programs. If the profile shows that a particular viewer does not 
enjoy violence, the system can automatically branch to another video signal at the commencement of a fight in a sports 
program. Furthermore, such a user profile could be modified or enriched over time based on selections made during 

20 future interactive programs. For example, the 'memory' technique described above can be used to modify the user 
profile based on user response over time. 

[0099] Event data is collected from the viewer when the following command is received and processed by the con- 
troller 260 in the interactive digital cable box 25: 

25 VIEWER PROFILE 

[0100] This command is used to enable events which can be utilized for profiling during a show. The events indicated 
in this command are those profiling events which are possible during the show. The enabled events may be either 
selected by the viewer during the show, or may be automatically enabled based upon viewer selections. 

30 VIEWER_PROFILE EVENT1 ,...EVENT24 

[0101] Once the profile is created, the programming choices or interactive responses can be triggered based on the 
content of the viewer profile itself. For example, if the viewer profile suggests that the viewer is particularly interested 
in sports cars, a sports car commercial could be played for the viewer at a predetermined point in the program. As 
another application, if a viewer's profile indicates that the viewer is interested in cooking, whenever the viewer watches 

35 such a program, the user profile would trigger the interactive program to download recipes and either display such 
recipes on the screen or send the recipes to an attached printer. 

[0102] Viewer profile information can then be collected at the control studio 5 through polling of the viewer cable 
boxes 25 for viewer selection data. Special polling software is loaded into the digital set top box 25 for performing the 
polling functions. Alternatively, the invention allows for the digital set top boxes 25 to send back data on command from 
40 the control studio 5 or periodically. The command to initiate an upload of viewer profile data is as follows: 

UPLOAD EXTENDED 

[0103] This command is used to initiate the uploading of data to the central site. 

45 



UPLOAD_EXTENDED UPLOADJDENTIFIER VARIABLE_NAME [P HON E_N UMBER] 


UPLOADJDENTIFIER 

VARIABLE_NAME 

PHONE_NUMBER 


numeric constant identifying upload. 

name of variable to be uploaded string, that consists of numbers only, it 
can be omitted, if not needed. 



[0104] Regardless of whether a polling or periodic scheme is used, the statistics and other user profile information 
is preferably sent back to the control studio 5 by use of the back-channel. 



55 H. Applications 

[0105] The embodiments, described above, allow for several possible applications. For example, in a live sports 
event 10, one channel could carry the standard video channel, with other channels carrying different camera angles 
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100 and/or close-ups of particular players. Other potential video options include instant replay, highlights, player sta- 
tistics via graphic overlays, etc. Graphics presenting statistical information on the players can be constantly updated 
using the Chyron system. 

[0106] The provision of trigger points 500, explained above, can provide for seamless integration of such video 
5 options during the sporting event, based on either the viewer responses to interrogatories at the beginning of the 
program and/or on the digital viewer profile. 

[0107] Further, the viewer can become the director with the present invention. For example, the viewer can choose 
which camera angles 100 to emphasize. In a broadcast of golf, the viewer can direct whether they desire to follow a 
particular player from hole-to-hole, focus on one particularly difficult hole. In this manner, the viewer can customize the 
10 sporting broadcast to meet his own interests. 

[0108] Further, the viewer can act as a director to create their own video. During a live concert 1 0, for example, the 
viewer selects various camera angles 100 at different times. These selections along with a time stamp, indicating the 
program time when each selection was made, are stored in memory 265. When the program is played back a second 
time, the processor 260 will automatically direct branching between the video channels according to the stored selec- 
ts tions at the time stamp. In this manner, a music video can be created by the viewer. 

[0109] The viewing experience can be further enlightening for the viewer by implementing games and contests during 
the live sporting event 10. For example, graphics overlays can be developed that query the viewer during the game. 
During a football broadcast, for example, viewers can be queried with such interrogatories as the following: 

20 What will be the next play? (RUN/PASS/KICK); 

Will the offense get the first down?; 
Will they score on this possession?; 
Pick the halftime score; 
Who will win? 

25 

[0110] Each viewer's responses can be sent back to the control studio 5 for tabulation of scores. Preferably; the 
responses are packaged at the digital cable box 25 and transmitted to the control studio 5 via the digital backchannel 
upon the UPLOAD EXTENDED command. Alternatively, tabulation of scores can take place at the digital cable box 
25 through the utilization of certain software in memory 265. Each correct answer can correspond to a certain number 
30 of points. At the end of the game, the interactive program preferably presents a graphic showing the viewer point total. 
If desired, advertisers could present special gift certificates for excellent performance in such games. The provision of 
such certificates would occur by displaying a certain code that a viewer can take to a store to receive the gift. In this 
manner, viewer interests in sports events can be enhanced. 

[0111] Further, the viewer has the option with the present invention to block out viewing of certain events. For ex- 
35 ample, if the viewer is adverse to violence during a sporting event or other type program, the system can block out 
such options from the viewer with the following data commands: 

EVENT 

40 [0112] This command is used to indicate occurrence of a certain event (e.g., a fight breaking out during a football 
game). 

EVENT EVENT_N UMBER 

EVENT_NUMBER is a numeric constant. 

45 ON EVENT EXECUTE MACRO 

[0113] This command is used to implement certain actions (such as an automatic branch to another video channel 
in order to block out violent event, for example), as soon as the event arrives. 
ON_EVENT EVE NT_N UMBER MACRO_NUMBER 
50 EVENT_N UMBER is a numeric constant. 
MACRO_NUMBER is a numeric constant. 

I. Two -Way Configuration 

55 [01 14] The live programming system of the present invention may be operated in a two way configuration, as illus- 
trated in Figure 7. In this mode, the various video signals are processed as previously described, being digitized and 
compressed at the control studio 5. The signals are then sent to a central switching station, or headend 30. 
[0115] In this embodiment, the switching between the various live digital signals is accomplished at the headend 30 
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rather than at the receiver. On the receive end, each digital set-top box 760 relays viewer selections back to the remotely 
located switching station 30. Preferably, the viewer selections are relayed by way of the digital back channel 770. 
However, the viewer selections may be relayed to the switching station 30 by any conventional means, such as two- 
way cable television, telephone or microwave transmission. The switching station 30 receives the viewer selection and 
5 routes the desired signal to a transmitter 750 which conventionally transmits the desired video down the appropriate 
digital cable channel for the particular viewer. 

[0116] At the central switching station 30, a demultiplexer 710 demultiplexes the compressed signals and places 
each on a separate bus channel 725. A number of remote control interactive switches 730, 732, 734, 736 are connected 
to the video signal bus 725. Based on the viewer selections, an algorithm stored in memory 265 and under processor 
10 260 control at the central switching station 30, a digital seamless switch is made and the selected video, audio and/or 
graphics are forwarded to the viewer home for display. 

[0117] Such a two-way embodiment could be implemented in a video dial tone or video server system. In such a 
system, only a single video channel 755 is necessary for each home. Once the viewer selection is received at the 
server site at the cable headend 30, a switch is made to the appropriate video stream and this stream is sent on the 

15 single channel 755 to the home. 

[0118] Alternatively, it may be desirable to transmit an interactive sporting event over a single telephone line. When 
the viewer enters a selection on their remote 20, a signal is sent by way of the telephone line to the central switching 
station 30 which routes the desired signal of the interactive program over the user's telephone line so that a single link 
handles both the interactive choice being made at the receiver and the transmission of that choice from the headend 

20 30 where the actual switching takes place in response to the interactive selection made at the receiver. 

[01 1 9] The two-way link between the viewer and switching station 30 may be used for other purposes. For example, 
demographic data may be transferred from the viewer to the broadcast network for commercial purposes, such as 
targeted advertising, billing, or other commercial or non-commercial purposes. 

[0120] While the present invention has been described primarily with respect to live events, and in particular sporting 
25 events, it has equal potential for enhancing content in other program categories. A viewer can become their own director 

of a murder mystery or other drama. By entering responses to displayed questions at the initiation of or during the 

show, the program will branch to alternative video/audio segments as a result of the user selections. In this manner, 

different viewers with different selections may end up with a different murderer at the conclusion of the broadcast. 

[0121] Using the foregoing embodiments, methods and processes, the interactive multimedia computer maximizes 
30 personalized attention and interactivity to subscribers in their homes in real time. Although the present invention has 

been described in detail with respect to certain embodiments and examples, variations and modifications exist which 

are within the scope of the present invention as defined in the following claims. 



35 Claims 

1. A viewer reception system (25) for receiving interactive programming, the interactive programming comprising a 
plurality of synchronized and compressed, live and prerecorded, video signals and graphics signals, a plurality of 
compressed, live and prerecorded audio signals, and branching codes which have been multiplexed with said 
40 video, graphics and audio signals, and said viewer reception system (25) comprising: 

a viewer interface (20) for receiving viewer entries; 

processing means (260), responsive to the viewer interface (20), for determining which of the received video, 
graphics and audio signals to play; 
45 a demultiplexer (21 0) for selecting and demultiplexing a specific video signal under the control of said process- 

ing means (260); 

a decompressor/decoder (215) connected to the demultiplexer (210) for decompressing the demultiplexed 
selected video signals; and 

a video frame buffer (230) for receiving and delaying play of a received video signal whereby a seamless 
50 switch to a further video signal may be directed by said processing means (260) at a predetermined, video 

switching time, the further video signal selected and the predetermined video switching time of the selection 
being a function of the branching codes; and 
display means (165) for displaying the selected video signal; 

and wherein the display means (165) is additionally arranged to display graphics signals extracted by said 
55 demultiplexer (210) as directed by said processing means; 

and the viewer reception system (25) further comprising: 

an audio switch (250) connected to the demultiplexer (210) for selecting and receiving a specific audio 
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signal as directed by said processing means (260), whereby a switch to a further audio signal may be 
directed by said processing means (260) at a predetermined, audio switching time, the further audio signal 
selected and the predetermined audio switching time being a function of the branching codes; and 
means (245) for playing the audio signal selected. 

5 

2. A viewer reception system as claimed in Claim 1, wherein the selection of the video and audio signals and the 
predetermined time of each selection is also a function of received viewer entries. 

3. A viewer reception system as claimed in Claim 1 or Claim 2, further comprising memory (265) for storing a viewer 
10 profile, and wherein the selection of the video and audio signals and the predetermined time of each selection is 

also a function of the stored viewer profile. 

4. A viewer reception system as claimed in any preceding claim, wherein the plurality of compressed live video signals 
correspond to different predetermined camera (100) angles of an event. 

15 

5. A viewer reception system as claimed in any preceding claim, wherein said processing means (260) selects one 
of the graphics signals at a predetermined time, the selection of the graphics signal being afunction of the branching 
codes. 

20 6. A viewer reception system as claimed in any preceding claim, wherein the display means (165) presents at least 
one interrogatory to the viewer, the content of the interrogatory involving program options, and the viewer entries 
corresponding to collected entries from the viewer via the viewer interface in response to the interrogatories. 

7. A viewer reception system as claimed in any preceding claim, wherein the interactive programming further com- 
25 prises one or more uniform resource locators specifying one or more Internet addresses of related Internet infor- 

mation segments obtained from Web sites (170) on the Internet, and wherein the reception system (25) further 
comprises: 

means (605) for decoding the uniform resource locators to determine the specified Internet addresses; 
30 means (61 0), connected to the decoding means, for retrieving the one or more Internet information segments 

residing at the determined Internet addresses; and 
means (165) for presenting the Internet information segments. 



35 



50 



8. A system for providing interactive digital programming, comprising: 



means (1 05) for receiving video signals from a plurality of video cameras (1 00), one or more of the cameras 
relaying a different predetermined view of a live event, the video receiving means (1 05) also receiving prere- 
corded video signals; 

means (115) for receiving audio signals corresponding to the live event, the audio receiving means (115) also 
40 receiving prerecorded audio signals; 

means (135) for generating one or more graphics signals; 

at least one digital compression device (125, 130) connected to the video receiving means (105), the audio 
receiving means (115), and said generating means (135), for digitally compressing the video, graphics and 
audio signals; 

45 processing means (135), connected to the compression device, for creating a set of data commands corre- 

sponding to the audio, graphics and video signals, the data commands including branching codes; 
a digital multiplexer (140), connected to the digital compression device (125, 130), for multiplexing the video, 
graphics and audio signals, and the data commands into a combined digital program stream; and 
means (175) for transmitting the combined digital program stream. 



9. A method for providing interactive digital programming, comprising the steps of: 



obtaining video signals from a plurality of video cameras (1 00), one or more of the cameras relaying a different 
view of a live event; 
55 obtaining prerecorded video signals; 

producing one or more audio signals corresponding to the live event; 
obtaining prerecorded audio signals; 
creating one or more graphics signals; 



16 



EP 0 965 227 B1 



10 



digitally compressing the video, graphic and audio signals; 

producing a set of data commands which correspond to the audio, graphics and video signals, the data com- 
mands including branching codes; 

digitally multiplexing the video, graphics and audio signals, and the data commands into a combined digital 
program stream; and 

transmitting the combined digital program stream. 

10. A method for receiving interactive programming, the live interactive programming comprising a plurality of digitally 
compressed video, audio, and graphics signals and branching codes, the method comprising the steps of: 



selecting one of the video signals and directing a seamless switch to the selected video signal at a first pre- 
determined time, the selection of the video signal and the first predetermined time of the selection being a 
function of the branching codes; 

selecting one of the audio signals and directing a switch to the selected audio signal at a second predetermined 
15 time, the selection of the audio signal and the second predetermined time of the selection being a function of 

the branching codes; 

demultiplexing the selected video and audio signals; 
decompressing the demultiplexed selected video and audio signals; 
displaying the selected video signal; and 
20 playing the selected audio signal. 

11. A method for receiving interactive programming as claimed in Claim 10, wherein the interactive programming 
further comprises one or more uniform resource locators specifying one or more Internet addresses of related 
Internet information segments obtained from Web sites on the Internet, and wherein the method further comprises 

25 the steps of: 

decoding the uniform resource locators to determine the specified Internet addresses; 

retrieving the one or more Internet information segments residing at the determined Internet addresses; and 

presenting the Internet information segments. 

30 

12. A method for receiving interactive programming as claimed in Claim 1 0 or Claim 1 1 , further comprising the steps 
of obtaining viewer entries, and selecting the video and audio signals and the predetermined time of each selection 
also as a function of the obtained viewer entries. 

35 13. A method of receiving interactive programming as claimed in any of Claims 1 0 to 12, further comprising the steps 
of gathering viewer specific information, and creating a viewer profile from the gathered viewer specific information, 
and selecting the video and audio signals and the predetermined time of each selection also as a function of the 
viewer profile. 

40 1 4. A method of receiving interactive programming as claimed in Claim 1 3, wherein the step of gathering viewer specific 
information comprises the steps of: 

displaying at least one interrogatory to the viewer, the content of the interrogatory involving program options; 
and 

45 collecting entries from the viewer in response to the interrogatories. 



Patentanspriiche 

1. Zuschauer-Empfangssystem (25) zum Empfangen von interaktiver Programmierung, wobei die interaktive Pro- 
grammierung eine Mehrzahl von synchronisierten und komprimierten, direkten und zuvor aufgezeichneten Vide- 
osignalen und Graphiksignalen, eine Mehrzahl von komprimierten, direkten und zuvor aufgezeichneten Audiosi- 
gnalen, und Verzweigungscodes aufweist, die mit den Video-, Graphik- und Audiosignalen gemultiplext wurden, 
und das Zuschauer-Empfangssystem (25) aufweist: 

eine Zuschauer-Schnittstelle (20) zum Empfangen von Zuschauer-Eingaben; 

eine Verarbeitungseinrichtung (260), die auf die Zuschauer-Schnittstelle (20) reagiert, urn festzustellen, wel- 
ches der empfangenen Video-, Graphik- und Audiosignale gespielt werden soil; 
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einen Demultiplexer (210) zum Auswahlen und Demultiplexer! eines spezifischen Videosignals unter der 
Steuerung der Verarbeitungseinrichtung (260); 

einen Dekomprimierer/Decodierer (215), welcher mit dem Demultiplexer (210) verbunden ist, urn die demul- 
tiplexten ausgewahlten Videosignale zu dekomprimieren; und 

einen Videorahmenpuffer (230) zur Aufnahme und Verzogerung des Abspielens eines empfangenen Video- 
signals, wodurch eine nahtlose Schaltung zu einem weiteren Videosignal durch die Verarbeitungseinrichtung 
(260) zu einer vorbestimmten Videoschaltzeit gesteuert werden kann, wobei das weitere ausgewahlte Vide- 
osignal und die vorbestimmte Videoschaltzeit der Auswahl eine Funktion der Verzweigungscodes ist; und 
eine Anzeigeeinrichtung (165) zum Anzeigen des gewahlten Videosignals; 

und wobei die Anzeigeeinrichtung (165) zusatzlich vorgesehen ist, um Graphiksignale anzuzeigen, die von 
dem Demultiplexer (21 0) wie von der Verarbeitungseinrichtung gesteuert extrahiert werden; 
und wobei das Zuschauer-Empfangssystem (25) weiterhin aufweist: 

einen Audioschalter (250), welcher mit dem Demultiplexer (210) zum Auswahlen und Empfangen eines 
spezifischen Audiosignals, wie es von der Verarbeitungseinrichtung (260) gesteuert wird, verbunden ist, 
wodurch ein Schalten zu einem weiteren Audiosignal von der Verarbeitungseinrichtung (260) zu einer 
vorbestimmten Audioschaltzeit gesteuert werden kann, wobei das weitere gewahlte Audiosignal und die 
vorbestimmte Audioschaltzeit eine Funktion der Verzweigungscodes sind; und 
eine Einrichtung (245) zum Spielen des gewahlten Audiosignals. 

Zuschauer-Empfangssystem nach Anspruch 1, wobei die Auswahl der Video- und Audiosignale und die vorbe- 
stimmte Zeit jeder Auswahl auch eine Funktion von empfangenen Zuschauereingaben ist. 

Zuschauer-Empfangssystem nach Anspruch 1 oder 2, welches weiterhin einen Speicher (265) zum Speichern 
eines Zuschauerprofils aufweist, und wobei die Auswahl der Video- und Audiosignale und die vorbestimmte Zeit 
jeder Auswahl auch eine Funktion des gespeicherten Zuschauerprofils ist. 

Zuschauer-Empfangssystem nach einem der vorhergehenden Anspruche, wobei die Mehrzahl von komprimierten 
direkt ubertragenen Videosignalen unterschiedlichen vorbestimmten Kamera (1 00)-Winkeln einer Veranstaltung 
entspricht. 

Zuschauer-Empfangssystem nach einem der vorhergehenden Anspruche, wobei die Verarbeitungseinrichtung 
(260) eines der Graphiksignale zu einem vorbestimmten Zeitpunkt wahlt, wobei die Auswahl des Graphiksignals 
eine Funktion der Verzweigungscodes ist. 

Zuschauer-Empfangssystem nach einem der vorhergehenden Anspruche, wobei die Anzeigeeinrichtung (165) 
mindestens eine Fragestellung dem Zuschauer prasentiert, wobei der Inhalt der Fragestellung Programmoptionen 
beinhaltet, und die Zuschauereingaben gesammelten Eingaben des Zuschauers uber die Zuschauer-Schnittstelle, 
in Reaktion auf die Fragestellzung entsprechen. 

Zuschauer-Empfangssystem nach einem der vorhergehenden Anspruche, wobei die interaktive Programmierung 
weiterhin eine oder mehr Vereinheitlichte Quellenangaben (URL) aufweisen, welche eine oder mehr Internet- 
Adressen von zugehorigen Internetinformations-Segmenten, erhalten von Websites (170) im Internet, angeben 
und wobei das Empfangssystem (25) weiterhin aufweist: 

eine Einrichtung (605) zum Decodieren der Vereinheitlichten Quellenangaben um die angegebenen Interne- 
tadressen zu bestimmen; 

eine Einrichtung (610), die mit der Decodiereinrichtung verbunden ist, um die eine oder mehr Internetinfor- 
mations-Segmente zu lesen, die an den vorbestimmten Internetadressen vorhanden sind; und 
eine Einrichtung (165) zum Darstellen der Internetinformations-Segmente. 

System zum Bereitstellen einer interaktiven digitalen Programmierung, das auweist: 

eine Einrichtung (1 05) zum Empfangen von Videosignalen von einer Mehrzahl von Videokameras (1 00), wobei 
eine oder mehr der Kameras eine unterschiedliche vorbestimmte Ansicht einer direkt ubertragenen Veran- 
staltung ubertragen, wobei die Video-Empfangseinrichtung (105) auch zuvor aufgezeichnete Videosignale 
empfangt; 

eine Einrichtung (115) zum Empfangen von Audiosignalen entsprechend der direkt ubertragenen Veranstal- 
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tung, wobei die Audio-Empfangseinrichtung (115) ebenfalls zuvor aufgezeichnete Audiosignale empfangt; 
eine Einrichtung (135) zum Erzeugen eines oder mehr Graphiksignale; 

mindestens eine digitale Komprimiervorrichtung (125,130), die mitder Video-Empfangseinrichtung (105), der 
Audio-Empfangseinrichtung (115) und der Erzeugungseinrichtung (135) verbunden ist zum digitalen Kompri- 
mieren der Video-, Graphik- und Audiosignale; 

eine Verarbeitungseinrichtung (135), die mit der Komprimiereinrichtung verbunden ist, urn einen Satz von 
Datenbefehlen entsprechend der Audio-, Graphik- und Videosignale zu erstellen, wobei die Datenbefehle 
Verzweigungscodes beinhalten; 

einen digitalen Multiplexer (140), welcher mit der digitalen Komprimiervorrichtung (125,130) verbunden ist, 
urn die Video-, Graphik- und Audiosignale und die Datenbefehle in einen kombinierten digitalen Programm- 
strom zu multiplexen; und 

eine Einrichtung (175) zum Ubertragen des kombinierten digitalen Programmstroms. 

9. Verfahren zum Bereitstellen interaktiver digitaler Programmierung das die folgenden Schritte aufweist: 

Erhalten von Videosignalen von einer Mehrzahl von Videokameras (100), wobei eine oder mehrere der Ka- 
meras eine unterschiedliche Ansicht einer direkt ubertragenen Veranstaltung ubertragen; 
Erhalten von vorher aufgezeichneten Videosignalen; 

Erzeugen von einem oder mehr Audiosignalen entsprechend der direkt ubertragenen Veranstaltung; 

Erhalten von zuvor aufgezeichneten Audiosignalen; 

Erstellen eines oder mehrerer Graphiksignale; 

digitales Komprimieren der Video-, Graphik- und Audiosignale; 

Erzeugen eines Satzes von Datenbefehlen, welche den Audio-, Graphik- und Videosignalen entsprechen, 
wobei die Datenbefehle Verzweigungscodes beinhalten; 

digitales Multiplexen der Video-, Graphik- und Audiosignale und der Datenbefehle in einen kombinierten di- 
gitalen Programmstrom; und 

Ubertragen des kombinierten digitalen Programmstroms. 

10. Verfahren zum Empfangen einer interaktiven Programmierung, wobei die direkt ubertragene interaktive Program- 
mierung eine Mehrzahl von digital komprimierten Video-, Audio- und Graphiksignalen und Verzweigungscodes 
aufweist, wobei das Verfahren die folgenden Schritte aufweist: 

Auswahlen eines der Videosignale und Steuern eines nahtlosen Schaltens auf das ausgewahlte Videosignal 
zu einem ersten vorbestimmten Zeitpunkt, wobei die Auswahl des Videosignals und der erste vorbestimmte 
Zeitpunkt der Auswahl eine Funktion der Verzweigungscodes ist; 

Auswahlen eines der Audiosignale und Steuern eines Schaltens an das ausgewahlte Audiosignal zu einem 

zweiten vorbestimmten Zeitpunkt, wobei die Auswahl des Audiosignals und der zweite vorbestimmte Zeitpunkt 

der Auswahl eine Funktion der Verzweigungscodes ist; 

Demultiplexen der gewahlten Video- und Audiosignale; 

Dekomprimieren der demultiplexten ausgewahlten Video- und Audiosignale; 

Anzeigen des gewahlten Videosignals; und 

Abspielen des gewahlten Audiosignals. 

11. Verfahren zum Empfangen von interaktiver Programmierung nach Anspruch 10, wobei die interaktive Program- 
mierung weiterhin eine oder mehr Vereinheitlichte Quellenangaben aufweist, die eine oder mehr Internetadressen 
von zugehorigen Internetinformations-Segmenten angeben, die von Websites im Internet erhalten wurden, und 
wobei das Verfahren weiterhin die folgenden Schritte aufweist: 

Decodieren der Vereinheitlichten Quellenangaben zum Bestimmen der angegebenen Internetadressen; 
Lesen des einen oder mehr Internetinformations-Segments/Segmente, das/die an den vorbestimmten Inter- 
netadressen vorhanden ist/sind; und 
Prasentieren der Internetinformations-Segmente. 

12. Verfahren zum Empfangen von interaktiver Programmierung nach Anspruch 10 oder 11, welches weiterhin fol- 
gende Schritte aufweist: Erhalten von Zuschauereingaben und Auswahlen der Video- und Audiosignale und des 
vorbestimmten Zeitpunkts jeder Auswahl auch als Funktion der erhaltenen Zuschauereingaben. 

13. Verfahren zum Empfangen interaktiver Programmierung nach einem der Anspruche 1 0 bis 12, welches weiterhin 
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die folgenden Schritte aufweist: Sammeln von zuschauerspezifischer Information und Erzeugen eines Zuschau- 
erprofils aus der gesammelten zuschauerspezifischen Information und Auswahlen der Video- und Audiosignale 
und des vorbestimmten Zeitpunkts jeder Auswahl ebenfalls als Funktion des Zuschauerprofils. 

14. Verfahren zum Empfangen interaktiver Programmierung nach Anspruch 13, wobei der Schritt des Sammelns von 
zuschauerspezifischer Information die folgenden Schritte aufweist: 

Anzeigen mindestens einer Fragestellung an den Zuschauer, wobei der Inhalt der Fragestellung Programm- 
optionen beinhaltet; und 

Sammeln von Eingaben von dem Zuschauer in Reaktion auf die Fragestellung. 



Revendications 

1 . Un systeme de reception de telespectateur (25) pour recevoir des emissions audiovisuelles interactives, les emis- 
sions audiovisuelles interactives comprenant une pluralite des signaux video et graphiques, synchronises et com- 
presses, en direct et preenregistres, une pluralite de signaux audio compresses, en direct et preenregistres, et 
des codes de branchement qui ont ete multiplexes avec lesdits signaux video, graphiques et audio, et ledit systeme 
de reception telespectateur (25) comprenant : 

une interface de telespectateur (20) pour recevoir des entrees du telespectateur; 

des moyens de traitement (260), repondant a I'interface de telespectateur (20), pour determiner quels signaux 
video, graphiques et audio recus doivent etre reproduits ; 

un demultiplexer (21 0) pour selectionner et demultiplexer un signal video specifique sous la commande des- 
dits moyens de traitement (260); 

un decompresseur/decodeur (215) connecte au demultiplexeur (210) pour decompresser les signaux video 
demultiplexes selectionnes ; et 

un tampon de trames video (230) pour recevoir et retarder la reproduction d'un signal video recu dans lequel 
une commutation sans raccord vers un signal video supplemental peut etre adressee par lesdits moyens 
de traitement (260) a un instant de commutation video predetermine, le signal video supplementaire selec- 
tionne et I'instant de commutation video predetermine etant une fonction des codes de branchement ; et 
des moyens de visualisation (165) du signal video selectionne ; 

et dans lequel les moyens de visualisation (1 65) sont en plus agences pour visualiser des signaux graphiques 
extraits par ledit demultiplexeur (210) comme adresse par lesdits moyens de traitement ; et 
le systeme de reception de telespectateur (25) comprenant en outre: 

un commutateur audio (250) connecte au demultiplexeur (210) pour selectionner et recevoir un signal 
audio specifique comme adresse par lesdits moyens de traitement (260), dans lequel une commutation 
vers un signal audio supplementaire peut etre adressee par lesdits moyens de traitement (260) a un 
instant de commutation audio predetermine, le signal audio supplementaire selectionne et I'instant de 
commutation audio predetermine etant une fonction des codes de branchement ; et 
des moyens (245) de reproduction du signal audio selectionne. 

2. Un systeme de reception de telespectateur selon la revendication 1, dans lequel la selection des signaux video 
et audio et I'instant predetermine de chaque selection sont egalement une fonction des entrees regues du teles- 
pectateur. 

3. Un systeme de reception de telespectateur comme revendique dans les revendications 1 ou 2, comprenant en 
outre de la memoire (265) pour stocker un profil de telespectateur, et dans lequel la selection des signaux la video 
et audio et I'instant predetermine de chaque selection sont egalement une fonction du profil stocke de telespec- 
tateur. 

4. Un systeme de reception de telespectateur comme revendique dans Tune quelconque des revendications prece- 
dentes, dans lequel la pluralite de signaux video compresses en direct correspond a differents (100) angles pre- 
determines de cameras pour un evenement. 

5. Un systeme de reception de telespectateur comme revendique dans I'une quelconque des revendications prece- 
dentes, dans lequel lesdits moyens de traitement (260) selectionnent un des signaux graphiques a un instant 
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predetermine, la selection du signal graphique etant une fonction des codes de branchement. 

6. Un systeme de reception de telespectateur comme revendique dans Tune quelconque des revendications prece- 
dentes, dans lequel les moyens d'affichage (165) presentent au moins une interrogation au telespectateur, le 

5 contenu de Interrogation impliquant des options de programme, et les entrees du telespectateur correspondant 

aux entrees collectees par le telespectateur via I'interface de telespectateur en reponse a I'interrogation. 

7. Un systeme de reception de telespectateur comme revendique dans Tune quelconque des revendications prece- 
dentes, dans lequel les emissions audiovisuelles interactives comportent un URL ou plus specifiant une ou plu- 

10 sieurs adresses Internet de segments Internet d'information apparentes obtenus a partir de sites WEB (170) sur 

I'lntemet, et dans lequel le systeme de reception (25) comprend en outre: 

des moyens (605) de decodage des URLs pour determiner les adresses Internet specifiees ; 
des moyens (610) connectes aux moyens de decodage, pour la recherche des un ou plusieurs segments 
15 d'information residant aux adresses Internet determinees ; et 

des moyens (165) pour presenter les segments d'information Internet. 

8. Un systeme pour fournir des emissions audiovisuelles numeriques interactives, comprenant: 

20 des moyens (1 05) pour recevoir des signaux video d'une pluralite de cameras video (1 00), une ou plusieurs 

de ces cameras video relayant une vue predeterminee differente d'un evenement en direct, les moyens de 
reception video (105) recevant egalement des signaux video preenregistres ; 

des moyens (115) pour recevoir des signaux audio correspondant a I'evenement en direct, les moyens de 
reception audio (115) recevant egalement des signaux video preenregistres ; 
25 des moyens (135) pour la generation d'un ou plusieurs signaux graphiques ; 

au moins un dispositif de compression numerique (1 25, 1 30) connecte aux moyens de reception video (1 05), 
aux moyens de reception audio (1 1 5), et aux dits moyens de generation (1 35), pour compresser numerique- 
ment les signaux video, graphiques et audio ; 

des moyens de traitement (135), connectes au dispositif de compression, pour creer une sequence de com- 
30 mandes de donnees correspondant aux signaux video, graphiques et audio, les commandes de donnees 

incluant des codes de branchement ; 

un multiplexeur numerique (140), connecte au dispositif numerique de compression (125, 130), pour multi- 
plexer les signaux video, graphiques et audio, et les commandes de donnees dans un flux de programme 
numerique combine ; et 
35 des moyens (175) pour transmettre le flux de programme numerique combine. 

9. Une methode pour fournir des emissions audiovisuelles numeriques interactives, comprenant les etapes de: 

obtention de signaux video a partir d'une pluralite cameras video (100), une ou plusieurs de ces cameras 
40 video relayant une vue differente d'un evenement en direct ; 

obtention de signaux video preenregistres ; 

production d'un ou plusieurs signaux audio correspondant a I'evenement en direct ; 
obtention de signaux audio preenregistres ; 
creation d'un ou plusieurs signaux graphiques ; 
45 compression numerique des signaux video, graphiques et audio ; 

production d'une sequence de commandes de donnees qui correspondent aux signaux audio, graphiques et 
video, les commandes de donnees incluant des codes de branchement ; 

multiplexage numerique des signaux video, graphiques et audio, et des commandes de donnees dans un flux 
combine de programme numerique ; et 
50 transmission du flux de programme numerique combine. 

10. Une methode pour recevoir des emissions audiovisuelles interactives, les emissions audiovisuelles interactives 
en directe comprenant une pluralite de signaux numeriquement compresses video, audio, et des codes de bran- 
chement, la methode comprenant les etapes de: 

55 

selection d'un des signaux video et d'adressage d'une commutation sans raccord vers le signal video selec- 
tionne a un premier instant predetermine, la selection du signal video et le premier instant predetermine de 
selection etant une fonction des codes de branchement ; 
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selection d'un des signaux audio et d'adressage d'une commutation sans raccord vers le signal audio selec- 
tionne a un deuxieme instant predetermine, la selection du signal audio et le deuxieme instant predetermine 
etant une fonction des codes de branchement ; 
demultiplexage des signaux video et audio selectionnes ; 
decompression des signaux video et audio demultiplexes selectionnes ; 
visualisation du signal video selectionne ; et 
reproduction du signal audio selectionne. 

1. Une methode pour recevoir des emissions audiovisuelles interactives comme revendique dans la revendication 
10, dans laquelle les emissions audiovisuelles interactives comportent en outre une ou plusieurs URLs indiquant 
une ou plusieurs adresses Internet une ou plusieurs adresses Internet de segments Internet d'information appa- 
rentes obtenus a partir de sites WEB, et la methode comprenant en outre les etapes de : 

decodage des URLs pour determiner les adresses Internet indiquees ; recherche des un ou plusieurs seg- 
ments d'information Internet residant aux adresses Internet determinees ; et 
presentation des segments d'information Internet. 

2. Une methode pour recevoir des emissions audiovisuelles interactives comme revendique dans les revendications 
1 0 ou 1 2, comprenant en outre les etapes d'obtention d'entrees du telespectateur, et de selection de signaux video 
et audio, I'instant predetermine de chaque selection etant egalement une fonction des entrees de telespectateur 
obtenues. 

3. Une methode pour recevoir des emissions audiovisuelles interactives comme revendique dans I'une quelconque 
des revendications 10 a 12, comprenant en outre les etapes de collecte d'informations specifiques du telespecta- 
teur, et de creation d'un profil de telespectateur a partir des informations de telespectateur collectees, et de se- 
lection de signaux video et audio, I'instant predetermine etant egalement une fonction du profil de telespectateur. 

4. Une methode pour recevoir des emissions audiovisuelles interactives comme revendique dans la revendication 
13, dans laquelle I'etape de collecte d'informations specifiques de telespectateur comprend les etapes de: 

visualisation d'au moins une interrogation du telespectateur, le contenu de cette interrogation impliquant des 
options de programme ; et 

collecte d'entrees du telespectateur en reponse aux interrogations. 



22 



EP 0 965 227 B1 




23 



EP 0 965 227 B1 



o 

CO 



LjO 
CO 
CM 



o 

CVJ 



VIDEO 
FRAME 
BUFFER 




GEN. LOCK 
CIRCUIT 




\CTER 
*ATOR 
RLAY 






CHAR/ 
GENEF 
QVFI 




24 



EP 0 965 227 B1 



o 

8 



3 

CM 



FRAME 
SYNC 






SYNC 


ADD 




in 



o 

CO 




FRAME 
SYNC 






SYNC 


ADD 



CM 



DECOM- 

DDCCC/ 


r i iloo/ 

DECODER 






DIGITAL 
VIDEO 
BUFFER 



CO 

O 




25 



EP 0 965 227 B1 



LO 



>-tr 
cc LU 
O != 

22 
uj o 
So. 



• 



CM 



o wo 

LU CC UJ 




o 

CNJ 



in 
o 

CNJ 



o 
o 

CM 



DIGITAL 


DEMUX 






FEC 






RF 
DEMOD 



o 



o 
o 



CD 
CM 



Q O 

Pi 




26 



EP 0 965 227 B1 



FIG. 5 



\S PROGRAM 
f START 



TRIGGER 
POINT 500 



• * 



STANDARD AUDIO 



ts 



SELECT AUDIO 



ti- 



ts 



VIDEO 1 



I 



SELECT 
VIDEO 



GRAPHICS 0 



VIDEO 2 



TRIGGER 
POINT 500 




• 



27 



EP 0 965 



227 B1 




28 



EP 0 965 227 B1 



o 

CO 



to 




CONTROL 
STUDIO 




RF 
DEMOD. 





29 



